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SANTRAUKA 

Pagrindinis sio tyrimo tikslas - nustatyti 
„Studentai jvertina destymq“ (toliau - SjD) 
metodo efektyvumq remiantis universitetij 
destytojij ir studentq nuomone. Tyrimui pa- 
sirinkta zvalgybine aprasomoji analize. Da- 
lyvavo 300 destytojij ir 600 magistranturos 
studiju studentij is 3 Irano aukstijjij mokyklij. 
Duomenims rinkti pasirinkta 30 punktij an- 
keta. Atsakymams pateikti naudota 5 balij Li¬ 
kert o skale (nuo visiskai nesutinku iki visiskai 
sutinku). Tyrimas parode, kad Cronbacho alfa 
koeficientai yra pakankamo lygmens (desty- 
tojams - .86, o studentams - .88). Statistiskai 
reiksmingi skirtumai tarp destytojij ir studen¬ 
tq nustatyti atsizvelgiant j lytj, darbo patirtj, 
pareigu statusq ir pagrindin^ studijavimo 
kryptj. Destytojai sutinka, kad reiketij naudo- 
ti skirtingus jvertinimo metodus (pvz., kole- 
gq jvertinimq, savqs jvertinimq ir administra- 
toriu atliekamij ivertinim;j), o ne pasikliauti 
vien „Studentai jvertina destym;j“ metodu. 
Tyrimas atskleidzia abejones del SjD metodo 
naudojimo Irano aukstojo mokslo sistemoje 
bei kelia klausimus, ar teisinga naudoti tokj 
reitingavim;j priimant sprendimus, susijusius 
su destytojij pareigomis. Tyrimo rezultatai 
rodo: nustatant destymo kokyb^, SjD metodij 
reiketij naudoti itin atsargiai. 


ABSTRACT 

The main purpose of this research is to examine 
the effectiveness of Student Evaluation of Teach¬ 
ing (SET) from a sample of university teachers’ 
and students’ view. The study adopts explor¬ 
atory descriptive design. Participants of this 
research were 300 teachers and 600 graduate 
students from 3 Iranian higher education insti¬ 
tutions. A 30-item format questionnaire was the 
main instrument for data collection. Responses 
to the items were made on a five-point Likert 
scale anchored with strongly agree and strongly 
disagree. Results show that Cronbach alfa coef¬ 
ficients of measures are in satisfactory level (.86 
for teachers’ version and .88 for students’ ver¬ 
sion). There are statistically significant differ¬ 
ences among teachers and students based on 
gender, teaching experience, tenure and major. 
The teachers highly agreed with using differ¬ 
ent evaluation methods (e.g., peers evaluation, 
self-evaluation, and administrators) instead of 
merely relay on Student evaluation of teaching 
method. The study presents a challenge to the 
use of SET in higher education system in Iran 
and, in particular, raises questions about fair¬ 
ness if such ratings are to be used in decisions 
relating to employment issues. The findings 
suggest that SET should be applied cautiously in 
faculty performance evaluation. 
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PAGRINDINiy SAVOKy APIBREZIMAI 

• „Studentai jvertina destymq“ metodas - 
dazniausiai naudojama priemone destymo 
efektyvumui auditorijoje nustatyti. Taciau 
studentq pateikiami reitingavimai turi savij 
trukumq, ypac, kai jie yra vienintelis destymo 
jvertinimo metodas, naudojamas priimant 
sprendimus, susijusius su etato skyrimu ar 
paaukstinimu. jrodymus apie destymo efek- 
tyvumq katedros turetq rinkti is jvairiq salti- 
niq ir naudotis kolegij jvertinimo isvadomis, 
studentp laiskais, parengtomis programomis 
ir metodine medziaga, individualiais desty¬ 
mo patirties aplankais. Pagrjstai parengtos 
studentrj jvertinimo priemones turetq buti 
tokio jvertinimo dalis, kadangi parodo issa- 
mesnj vaizdq apie destymo kokybq. Kita ver- 
tus, studentq atsiliepimai yra naudinga prie¬ 
mone destytojams, norintiems pagerinti savo 
destymq. 

• Destymo efektyvumas. Nera vienos nuomo- 
nes, is ko susideda efektyvus destymas. J. Patric- 
kas ir R. Smartas (1998) isskiria tris efektyvaus 
destymo veiksnius: (1) pagarba studentams, 
(2) organizuotumas ir pristatymo mokejimai 
bei (3) gebejimas motyvuoti studentus. Kiti 
tyrimai skiria daugiau ir kitokiij veiksniq. 
Destymo efektyvumas yra svarbus, nes padeda 
studentams geriau studijuoti. Aukstojo moks- 
lo sistemoje vis daugiau demesio skiriant ko- 
kybei, efektyvus destymas tapo dar svarbesnis. 
Bet jis nepasireiskia atsitiktinai. 

• Halo efektas siejamas su pazintiniu sa- 
liskumu, kai tam tikra savybe suvokiama 
ir interpretuojama pagal anksciau pasi- 
reiskusias savybes. Halo efektas jtrauktas j 
H. H. Kelleyo (1950) implicitin^ asmenybes 
teorijcj. Remdamiesi sia teorija, mes interpre- 
tuojame ir suvokiame kitvj. zmonip savybes 
pagal tai, kokias savybes pirmiausia juose 
pamatome. Daznai manoma, kad patrauklios 
isvaizdos zmones yra jdomesnes ir profesio- 
nalesnes asmenybes. 


DEFINITIONS OF KEYWORDS 

• Student evaluation of teaching is the most 
commonly used method of assessing an in¬ 
structor’s effectiveness in the classroom. 
However, student ratings do have their limita¬ 
tions, especially when they represent the only 
method of teaching evaluation used in tenure 
or promotion decisions. Departments should 
gather evidence of teaching effectiveness from 
a variety of sources. These may include: peer 
evaluations, letters from students, syllabi and 
instructional support materials, and individ¬ 
ual teaching portfolios. Student evaluations, if 
they are properly constructed, should be part 
of this mix because they offer an indispensible 
perspective on an instructors effectiveness. 
Moreover, student feedback is an important 
tool for individual instructors who wish to im¬ 
prove their teaching. 

• Teaching effectiveness. There is little agree¬ 
ment as to what constitutes effective teaching. 
Patrick and Smart (1998) identify the three 
factors of teaching effectiveness as (1) respect 
for students, (2) organization and presentation 
skills, and (3) ability to challenge students. 
Further studies identify more and different 
factors of teaching effectiveness. Teaching 
effectiveness is important because effective 
teaching helps student learning. It has become 
even more important as the emphasis on qual¬ 
ity in higher education has increased. Effective 
teaching does not occur by chance. 

• Halo effect refers to a cognitive bias whereby 
the perception of a particular trait is influ¬ 
enced by the perception of the former traits in 
a sequence of interpretations. The halo effect is 
involved in Kelleys (1950) implicit personal¬ 
ity theory, where the first traits we recognize in 
other people then influence the interpretation 
and perception of latter ones. Attractive peo¬ 
ple are often judged as having a more desirable 
personality and more skills than someone of 
average appearance. 
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JVADAS 

Siame standartq ir atskaitomybes amziuje 
aukstosios mokyklos kaip vienq is destymo 
sistemos jvertinimo komponentij vis daz- 
niau naudoja studentq reitingavimo 1 skales 
(Seldin, 1993). Daugelyje Irano universitetij 
visi destytojai privalo arba turetq kiekvieno 
destomo kurso metu vienq ar kelis kartus 
savo studentams pateikti destymo jverti¬ 
nimo form;}.. Daugybe straipsniq ir knygi} 
skirti sudetingiems „Studentai jvertina des- 
tym;}“ (SjD) metodo tyrimams. Toks tyrimi} 
kiekis rodo SjD metodo svarb;} aukstojo 
mokslo sistemoje. Nors kai kurie tyrimai pa¬ 
rade SjD metodq esant pagrjstu vertinimo 
metodu, kiti atskleide jo trukumus (Steiner 
ir kt., 2006). Vis delto, nepaisant sip pries- 
taringi} rezultati) ir akademinio pasaulio 
atstovi} reiskiamo susirupinimo, SjD me- 
todas tebera dazniausiai naudojama prie- 
mone destymo efektyvumui nustatyti Irano 
aukstojo mokslo sistemoje. Vienas didziau- 
siq studenti} jtraukimo j destytojij destymo 
kokybes reitingavim;} privalumi}, kurj verta 
cia pamineti, yra tai, kad kuriant ir pildant 
formas destytojai ir studentai skatinami ref- 
lektuoti savo patirtj svietimo sistemoje ir 
taip susikurti aiskesn^ koncepcijq, kokiq pa- 
stangu reikia norint pasiekti geresniq desty¬ 
mo ir studijavimo rezultati}. Is esmes galima 
isskirti dvieji} rusiij jvertinimus - formuo- 
jantj ir apibendrinantj. Formuojantis jverti- 
nimas yra proceso ar produkto jvertinimas 
suteikiant grjztamqjj rysj, kuriuo siekiama 
padaryti pakeitimus ar tobulinti vykstant 
procesui. Apibendrinantis jvertinimas skir- 
tas galutinio, baigto proceso ar produkto ko- 
kybei ar poveikiui istirti 2 . 

1 Straipsnyje kalbama apie studentq atiiekama destymo 
kokybes reitingavim^. 

2 Svietimo sistemoje apibendrinantis jvertinimas 
dazniausiai vyksta studijq dalyko pabaigoje ir yra naudoja- 
mas galutiniam jvertinimui nustatyti. Formuojantis jverti¬ 
nimas apima beveik visada iskart pateikiamus atsiliepimus, 
jgalinancius daryti pokycius dar tebeteikiant studijij dalyk^. 


INTRODUCTION 

In this era of standards and accountability, in¬ 
stitutions of higher education have increased 
their use of student rating 1 scales as an evalua¬ 
tive component of the teaching system (Seldin, 
1993). Virtually, all teachers at most Iranian 
universities are either required or expected to 
administer some type of teaching evaluation 
form to their students at one or more points 
during each course being offered. There are 
thousands of articles and books dealing with 
the extremely complex research on Students 
Evaluation of Teaching (SET). The quantity 
of research is indicative of the importance of 
SET in higher education. While some studies 
have found that using SET is generally a valid 
method of assessment, others have found it to 
be flawed (Steiner et al, 2006). In spite of these 
inconclusive results and concern about them 
shared by many in academia, SET is still the 
most common measure of teaching effective¬ 
ness in use today in Iranian higher education 
system. One of the most important benefits 
of involvement of students into the rating of 
quality of teachers teaching worth mention¬ 
ing here is that the process of designing or 
filling out the forms encourages teachers and 
students to reflect on their educational experi¬ 
ences, and as a result, develop clearer concep¬ 
tions about what efforts they must make in 
order to achieve better teaching and learning 
results. There are basically two types of evalu¬ 
ation: formative and summative. Formative 
evaluation refers to evaluation of a process or 
product to provide feedback for the purpose 
of making possible mid-process refinements 
or improvements. A summative evaluation is 
conducted to examine the quality or impact of 
a final, completed process or product 2 . 

1 The article presents how students rate teaching quality. 

2 In education summative evaluations occur usually at the 
end of the teaching of a course and are used to calculate a 
final assessment. Formative evaluations, on the other hand, 
are nearly always immediate feedback to bring about chang¬ 
es while a course is being taught. 
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Iprasta manyti, kad studenti} reitinga- 
vimas turi tris pagrindinius tikslus (Howell, 
Symbaluk, 2001). Pirmasis tikslas - padeti at- 
likti administracinius jvertinimus tiriant des¬ 
tymo efektyvumcj. Tai yra svarbus aspektas 
priimant sprendimus, susijusius su uzmokes- 
cio kelimu, paaukstinimu ir destytojij parei- 
gi} skyrimu (Carter, 1989). Antrasis studenti} 
reitingavimo tikslas - padeti studentams pa- 
sirinkti studiji} dalykus ir destytojus. Pasak 
W. B. Wilhelmo (2004), dauguma studenti} 
laiko studenti} reitingavim;} vertingu saltiniu 
priimant siuos sprendimus, nors destytojai 
daznai ir nerimauja del sir} i vert in imp pa- 
viesinimo. Siame straipsnyje akcentuojamas 
treciasis studenti} atliekamo destymo reitin¬ 
gavimo tikslas, t. y. suteikiant griztam;yi rysj 
padeti destytojams gerinti destymo kokyb^. 

Kelii} autorii} teigimu, kalbant apie stu¬ 
denti} reitingavimo poveikj destymo geri- 
nimui, butina atsizvelgti tiek j trumpalaiki, 
tiek ir j ilgalaikj poveik} (Armstrong, 1998; 
Greenwald, Gillmore, 1998). Ypac svarbus 
ilgalaikis poveikis, nes daugelis destytoji} 
dirba aukstosiose mokyklose kelerius me- 
tus ir nuolat sulaukia grjztamojo rysio bu- 
tent per studenti} reitingavim^. Vis delto, 
ankstesni tyrimai daugiausia buvo skirti 
vien trumpalaikiam grjztamojo rysio per 
studenti} reitingavim^ poveikiui; empirinii} 
tyrimi}, skirti} ilgalaikiam poveikiui, labai 
nedaug. Tai paskatino A. G. Greenwald^ ir 
G. M. Gillmore';.} (1998) imtis naujo tyrimo, 
skirto ilgalaikiam grjztamojo rysio per stu¬ 
denti} reitingavim^ poveikiui. Pletojant sicj 
tem;} pirmiausia pateikiami pagrindinii} s^- 
voki} apibrezimai. 

Destymo efektyvumas. Nera vienos nuo- 
mones, is ko susideda efektyvus destymas. Pa- 
vyzdziui, C. W. Swartzas ir kt. (1990) isskiria 
du efektyvaus destymo veiksnius - aiski} des- 
tym;} ir studenti} elgesio valdym;}. Kiti tyrimai 
mini daugiau ir kitokii} efektyvaus destymo 
veiksnii}. Pavyzdziui, J. Patrickas ir R. Smar- 
tas (1998) isskiria tris efektyvaus destymo 


Usually, it is assumed that student ratings 
serve three main purposes (Howell, Symbaluk, 
2001). The first is to aid administrative evalu¬ 
ations by measuring teaching effectiveness, 
which is an important criterion for decisions 
on matters such as pay increases, promotion, 
and tenure of college faculty (Carter, 1989). 
The second purpose of student ratings is to 
help students select courses and instructors. 
From the Wilhelms (2004) view most students 
consider student ratings a valuable resource 
for such decisions, though teachers often raise 
concerns about the publication of these evalu¬ 
ations. The focus of the present article lies on 
the third purpose of student ratings of teach¬ 
ing, which is to help teachers improve their 
teaching by providing them with feedback. 

Several authors have pointed out that both 
short and long-term effects should be taken 
into account when considering the impact of 
student ratings on the improvement of teach¬ 
ing (Armstrong, 1998; Greenwald, Gillmore, 
1998). Long-term effects are particularly im¬ 
portant because the majority of teachers re¬ 
main in higher education institutions for sev¬ 
eral years and receive regular feedback in the 
form of student ratings. Nevertheless, previous 
research has focused almost exclusively on the 
short-term effects of feedback from student 
ratings; empirical research on the long-term 
effects is very limited. This prompted Green¬ 
wald and Gillmore (1998) to call for new re¬ 
search on the long-term effects of feedback 
from student ratings. For this purpose, at first 
the definitions of key words are included. 

Teaching effectiveness. There is little 
agreement as to what constitutes effective 
teaching. For example, Swartz et al., (1990) 
identify the two factors of effective teaching 
as (1) clear instructional presentation, and 
(2) management of student behavior. Further 
studies identify more and different factors of 
teaching effectiveness. For example, Patrick 
and Smart (1998) identify the three factors 
of teaching effectiveness (see above). Other 
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veiksnius (zr. auksciau). Kiti tyrejai siulo net 
septynis (Ramsden, 1991) ar devynis (Marsh, 
Dunkin, 1992) efektyvaus destymo veiksnius. 

Halo efektas. Pasak P. G. Grussingo 
(1994), maziausiai penkiij rusiij reitingavimo 
salutiniai poveikiai gali sukelti reitingavimo 
klaidas. Svarbiausias jij - halo efektas. Ma- 
noma, kad studentij nuomone apie destytojq 
didzia dalimi nulems destymo efektyvumo 
reitingus. Todel halo efektas daznai pasireis- 
kia sudarant reitingus pagal SjD metodq (zr. 
auksciau). 

Atsizvelgiant j minetus faktus buvo at- 
liktas tyrimas, siekiant issiaiskinti studentij 
nuolat atliekamo grjztamojo rysio poveikj 
destymo efektyvumui per kelis semestrus. 
Pagrindinis sio tyrimo tikslas - remiantis 
trijq universitetij vakarij Irane destytojij ir 
studentij nuomone, istirti „Studentai jvertina 
destymij" (SjD) metodo efektyvumij. Tyrimo 
klausimai: 

1. Kokia destytojij nuomone apie skirtin- 
gij saltiniij, irodanciij destymo efektyviiimj, 
naudojirmj? 

2. Ar, destytojij nuomone, SjD metodas 
turi jtakos destymo kokybes gerinimui? 

3. Ar, studentij nuomone, SjD metodas 
turi jtakos destymo kokybes gerinimui? 

4. Ar zymiai skiriasi studentij ir destytojij 
nuomones apie SjD metodo efektyvurmj? 

5. Ar galima rasti rysj tarp destytojij de- 
mografiniq kintamijjij ir jij nuomones apie 
SjD metodo efektyviiimj? 

6. Ar galima rasti rysj tarp studentij de- 
mografiniij kintamijjij ir jij nuomones apie 
SJD metodo efektyviiimj? 

1 

METODAS 

Tyrimui atlikti pasirinktas aprasomojo ty¬ 
rimo metodas. Kiekybiniam tyrimui nau- 
dota apklausa. Pagrindinis tyrimas atliktas 
2009-2010m. 


researchers have suggested as many as seven 
factors (Ramsden, 1991) or nine factors of ef¬ 
fective teaching (Marsh, Dunkin, 1992). 

Halo effect. According to Grussing (1994) 
at least five kinds of rating effects may cause 
rating errors. The most important of them is 
halo effect. It is supposed that the student’s 
perception of the lecturer would significantly 
predict teaching effectiveness ratings. Thus, a 
halo effect often occurs in the completion of 
SET ratings (see above). 

In response, the researcher conducted a 
study to investigate systematically the effects of 
regular student feedback on the effectiveness 
of university teaching over a period of several 
semesters. The main purpose of the research 
was to examine effectiveness of SET from the 
views of teachers and students of the three 
universities in the west of Iran. Research ques¬ 
tions are as follows: 

1. What are teachers’ views on apply¬ 
ing different sources of evidence of teaching 
effectiveness? 

2. Does SET affect on teaching quality im¬ 
provement from the teachers’ view? 

3. Does SET affect on teaching quality im¬ 
provement from the students’ view? 

4. Is there any significant difference be¬ 
tween students’ and teachers’ view regarding 
effectiveness of SET? 

5. Is there any relationship between teach¬ 
ers’ demographic variables and their views re¬ 
garding effectiveness of SET? 

6. Is there any relationship between stu¬ 
dents’ demographic variables and their view 
regarding effectiveness of SET? 

1 

METHOD 

For the current study, the descriptive method of 
research is used. This quantitative investigation 
employs the survey method as its research de¬ 
sign. The main study was done in 2009-2010. 
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Dalyviai. Duomenys tyrimui rinkti 
trijose aukstosiose mokyklose - Kurdista- 
no universitete, Razi universitete ir Buali- 
sina universitete. Pasirinktos dvi dalyvii} 
grupes: 

1) Destytojij imtj sudare dirbantieji Kur- 
distano, Razi ir Bualisina universitetuose. Vi- 
suose tyrimu susidomejusiuose fakultetuose 
duomenims rinkti is viso isdalyta 300 anketrj. 
Kad duomenis butq lengviau palyginti, vi- 
suose tyrime dalyvaujanciuose universitetuo¬ 
se pasirinkti panasus fakultetai ir katedros. 
Sugnjzinta 260 anketi}, is kurii} 3 buvo pripa- 
zintos negaliojanciomis, nes jose truko duo- 
meni}. Taigi gautos 257 galiojancios anketos. 
Atsakymi} daznis - 83,25 proc. (246 vyrai ir 
11 moterq). 

2) Studenti} imtj sudare magistrantai, 
kurie bakalauro studijas baige minetuose 
universitetuose. Imtis sudaryta taikant ti- 
kimybinio sluoksniuoto imties parinkimo 
metodq. Is viso studentams isdalyta 650 an- 
ketq. Antroji tiriamijjij grupe gnjzino 600 
anketq (293 vyrai ir 307 moterys). Visi tyri- 
mo dalyviai buvo nuolatiniij studijij studen- 
tai. Kadangi jvertinimas buvo anoniminis 
ir konfidencialus, straipsnyje demografiniai 
duomenys nedetalizuojami ir aptariami 
apibendrintai. Tyrimo dalyviai turejo jver- 
tinti savo destytojij. Is viso buvo sureitin- 
guota desimt destytojij (astuoni vyrai ir dvi 
moterys). 

Priemones. Destytojij ir studentij nuo- 
monei apie destymo jvertinimo efektyvumij 
nustatyti naudotos patikimos ir pagrjstos 
tyrimo priemones. Sios priemones buvo is- 
bandytos su tyrimo imtimi, norint jvertinti 
kiekvieno aspekto vidinj patikimumij. Gauti 
rezultatai parode aukstq vidinj nuoseklum;j 
(remiantis Cronbacho alfa koeficientu), svy- 
ruojantj tarp .86 ir .88. 

Abi anketos prasidejo demografiniais 
klausimais, kuriij tikslas - nustatyti bet 
kokius demografinius veiksnius, galincius 
tureti jtakos tyrimo dalyviij atsakymams. 


Participants. Higher education institu¬ 
tions included in the data collection consists 
of three universities, University of Kurdistan, 
Razi University and Bualisina University. For 
the current study, the participants were com¬ 
prised of two groups: 

1) Teachers’ sample consisted of those who 
were working at the universities of Kurdistan, 
Razi and Bualisina. A total of 300 question¬ 
naires were distributed to all concerned fac¬ 
ulties for collecting the data. For ease of the 
comparison, similar departments and faculties 
from all universities were included in the study. 
260 questionnaires were returned, from which 
3 were discarded because of missing data. 
Therefore, the number of usable questionnaires 
was 257 and the response rate was 83.25 % (246 
males and 11 females). 

2) Student sample included undergradu¬ 
ate students who were staying in the afore¬ 
mentioned universities. Stratified random 
sampling technique was used for the selec¬ 
tion of the sample. Totally of 650 question¬ 
naires were distributed among students. 600 
questionnaires were returned to the second 
group of the research sample (293 males and 
307 females). Students were all enrolled full¬ 
time on courses. Due to the anonymous and 
confidential nature of the evaluation no details 
of demographic variables are available. The 
participants were required to rate their lectur¬ 
er. In total, ten lecturers (eight males and two 
females) were rated during this study. 

Instruments. Reliable and validated in¬ 
struments were used to measure teachers and 
students’ perceptions of the effectiveness of 
evaluation of teaching. The instruments were 
pilot tested on samples to assess the internal 
reliability of each dimension. The results in¬ 
dicate that internal consistencies (based on 
Cronbach’s alpha coefficient) are very high and 
ranges between .86 and .88. 

Both questionnaires began with a demo¬ 
graphics section to examine any demographic 
factors that might have influenced participants’ 
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Sioje anketos dalyje pateikti klausimai apie 
respondento lytj ir am zip, o destytojai dar 
turejo nurodyti darbo patirtj (metais) ir 
pareigas. Studentams skirtoje anketoje po 
demografines dalies pateikti nurodymai, 
kaip jcj uzpildyti, ir pateiktas efektyvaus 
destymo kintamijji} apibrezimas. Anketos 
poskaleje isdestyti punktai, skirti studijq 
dalykq destymo efektyvumui bei bendrai 
destytojq nuomonei apie destymo efektyvu- 
mq jrodantiems saltiniams vertinti. Anketq 
sudaro 30 punktij. Pirmieji 17 punktq skirti 
issiaiskinti bendrq nuomon^ apie SJD po- 
veikj destymo efektyvumui. Po to einantys 
5 punktai skirti visuotines kokybes sistemos 
kurimui. Tolesni astuoni anketos punktai 
leido tyrimo dalyviams pateikti savo nuo- 
mon^, atsizvelgiant j kai kuriuos veiksnius, 
kurie jvertinimo procese veikia kaip halo 
efektas. Galiausiai paskutiniai 16 klausimij 
buvo skirti destytojams apie saltinius, jro- 
dancius destymo efektyvumq. Atsakymams 
pateikti pasirinkta penkiij ball} Likerto skale 
(nuo visiskai nesutinku iki visiskai sutinku). 
1 lenteleje pateikta isversta aprasomoji sta- 
tistika ir alfa koeficientai. 

Visoms proceduroms atlikti naudota 
statistines analizes programmes jrangos 
SPSS® 17 versija, skirta Windows sistemai. 
Duomenims analizuoti naudoti zvalgybi- 
nes duomenp analizes, aprasomosios sta- 
tistikos, vienos imties t testo, nepriklauso- 
mos imties t testo, Friedmano ir ANOVA 
metodai. 


responses. It included gender, age, and for 
teachers the professional position and years of 
teaching experience in universities were taken 
into account. Following the demographics sec¬ 
tion, in the students’ version questionnaire, in¬ 
structions about how to complete items were 
provided along with a definition of teaching 
effectiveness variables. The questionnaire 
consisted of items measuring instruction ef¬ 
fectiveness subscale that participants had ob¬ 
served in courses, as well as teachers’ general 
opinions about sources of evidence of teach¬ 
ing effectiveness. A total of 30 items made up 
the questionnaire. The first 17 items inquired 
general opinions regarding the effect of stu¬ 
dents evaluation of teaching on instruction 
effectiveness and the next 5 inquired creating 
(developing) a total quality system. Afterward, 
eight items allowed participants to report their 
view regarding some factors that work as halo 
effect in evaluation process. Finally, a set of 16 
questions were asked of teachers regarding the 
sources of evidence of teaching effectiveness. 
The responses for items questionnaire were 
based on five-point Likert scale anchored with 
strongly agree and strongly disagree. Descrip¬ 
tive statistics and coefficient alphas for mea¬ 
sures after translation are shown in Table 1. 

SPSS® version 17 for Windows was the sta¬ 
tistical software program used to perform all 
procedures. For the data analyses exploratory 
data analysis, descriptive statistics, one sample 
t test, independent sample t test, Friedman and 
ANOVA were employed. 


1 lentele. Vidurkis (V), standartinis nuokrypis (SN) ir alfa koeficientas 

Table 1 . Means (M), Standard Diviations (SD) and coefficient Alphas of Measuers 


MATAI 

MEASURES 

V 

M 

SN 

SD 

PUNKTy 

SKAICIUS 

NO. OF ITEMS 

Alfa KOEFICIENTAS 

Alpha 


23,37 

5,96 

6 

0,907 


18,45 

4,48 

5 

0,813 


45,77 

11,01 

12 

0,932 
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2 

REZULTATAI 

Pasiektas sqlyginai aukstas atsakymij daznis. 
30 punktij apklausos rezultatai suskirstyti pa- 
gal sesis pirminius tyrimo klausimus. 

Pirmasis klausimas respondentams buvo 
„Kokia destytojij nuomone apie skirtingij sal- 
tiniij, jrodancnj destymo efektyvumq, naudo- 
jim;j?“. Friedmano neparametrinis testas nau- 
dotas siekiant suklasifikuoti saltinius, remiantis 
destytojq nuomone, irodancius destymo efek- 
tyvumq. 2 lenteleje pateikti kiekvieno saltinio 
vidutiniai rangai ir testo statistika. 

Is 2 lenteles matyti, kad rangai nera at- 
sitiktinai pasiskirstq, o vidutinis kiekvieno 
aspekto rangas skiriasi vienas nuo kito. Isty- 
rus Irano destytojij nuomonq paaiskejo: nera 
vienos nuomones apie saltiniij jvertinimq 
(X 2 r=521,98, df= 15 p<0,001). Didziausi ir 
maziausi vidutiniai rangai priklauso, atitin- 
kamai, „absolventrj reitingavimui“ ir „admi- 
nistratoriij reitingavimui“. 

Antrasis klausimas - „Ar, destytojij nuo¬ 
mone, SJD metodas turi jtakos destymo ko¬ 
kybes gerinimui?“ 

Destytojij poziurio vidurkis visais atve- 
jais buvo didesnis uz populiacijos vert£ 3 (3 
lentele). Vienos imties t testas parode, kad 
t vertes buvo reiksmingos P<.01. Vadinasi, 
destytojij nuomone, destymo jvertinimo 
rezultatai turi jtakos jq destymo efektyvu- 
mui ir visuotines kokybes sistemos kurimui 
universitetuose. Be to, jie pritaria teiginiui: 
jvertinimo procese kai kurios destyto¬ 
jij asmenines savybes gali veikti kaip halo 
efektas. 

Treciuoju klausimu noreta suzinoti, „Ar, 
studentij nuomone, SJD metodas turi jtakos 
destymo kokybes gerinimui?“ 

Abiem atvejais studentij poziurio vi¬ 
durkis buvo didesnis uz populiacijos verty 3 
(4 lentele). Vienos imties t testas parode, kad 
jie yra reiksmingi, P<.01. 


2 

RESULTS 

Relatively high response rates were achieved. 
The results from the 30 item surveys are 
grouped below based on six primary research 
questions which they addressed. 

The First question asked respondents: “What 
are teachers’ views on applying different sources 
of evidence of teaching effectiveness?” To rank 
sources of evidence of teaching effectiveness from 
the teachers’ view, the Friedman nonparametric 
test was applied. Mean ranks for each source and 
test statistics are shown in the Table 2. 

Table 2 shows that the ranks are not ran¬ 
domly distributed across the sources and mean 
rank for each approach is not similar to each 
other. The level of agreements regarding sourc¬ 
es of evaluation from the Iranian teachers’ view 
were significantly different (X 2 r=521.98, df= 15 
p<0.001). The highest and lowest mean ranks 
belonging to “alumni rating” and “administra¬ 
tor rating”, respectively. 

The second question asked: “Does SET af¬ 
fect on teaching quality improvement from the 
teachers’ view?” 

The means of teachers’ point of view in all 
cases were greater than the population value 
of 3 (Table 3). A one-sample t-test showed 
that the t-values were significant P<.01. These 
results reveal that teachers reported that the 
results of teaching evaluation have impact on 
their instruction effectiveness, and on devel¬ 
oping a total quality system in universities. In 
addition, they agreed with this statement that 
some teachers’ personal factors throughout the 
evaluation process could work as a halo effect. 

Moreover, the third question asked re¬ 
spondents: “Does SET affect on teaching qual¬ 
ity improvement from the students’ view?” 

The means of students’ point of view in 
both conditions were greater than the popula¬ 
tion value of 3 (Table 4). A one-sample t-test 
showed that these were significant, P<.01. 
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2 lentele. Saltinii), jrodanciq destymo efektyvumq, rangas. Destytojq nuomone 
Table 2. The Rank of Sources of Evidence of Teaching Effectiveness from Teachers'View 


SALTINIAI 

SOURCES 

VIDURKIS 

MEAN 

SN 

SD 

VIDUTINIS RANGAS 

MEAN RANK 

X 2 r 

df 

Sig. 

1. Studentij atliktas reitingavimas 
Student rating 

3,48 

1,11 

9,63 

522 

15 

.000 

2. Puikus studentai 

Excellent students 

3,84 

1,06 

11,3 




3. AbsolvenUj reitingavimas 
Alumni rating 

3,92 

.886 

11,7 




4. Kolegq reitingavimas 

Peer ratings 

2,88 

1,06 

6,83 




5. Katedros vadovas 

Department head 

3,07 

1,15 

8,12 




6. Administratoriq reitingavimas 
Administrator rating 

2,74 

.974 

6,32 




7. Isores ekspertai 

External experts 

2,99 

1,25 

7,71 




8. Sav^s jvertinimas 

Self-evaluation 

3,26 

1,03 

8,84 




9. Paties daryti vaizdo jrasai 

Videos by self 

3,13 

1,2 

8,48 




10. Kolegq daryti vaizdo jrasai 
Videos by peers 

2,80 

1,22 

6,91 




11. Interviu su studentais 

Students interviews 

3,28 

1,07 

9,17 




12. Darbdaviai 

Employers 

2,78 

1,03 

6,63 




13. Destymo stipendija 

Teaching scholarship 

3,03 

1,15 

7,69 




14. Destymo apdovanojimai 
Teaching awards 

3,51 

1,05 

9,97 




15. Studijq rezultatai 

Learning outcomes 

2,89 

.962 

7,20 




16. Stojamieji egzaminai 

Entrance exams 

3,35 

.990 

9,56 





3 lentele. Destytojq nuomone apie pagrindinius kintamuosius. Vienos imties t testas 
Table 3. Teachers'View Regarding Main Variables using one sample t-test 


PAGRINDINIAI KINTAMIEJI 

MAIN VARIABLES 

SK. 

N 

VID. 

M 

SN 

SD 

/VERTE 

f-VALUE 

df 

Destymo efektyvumas 

Instruction effectiveness 

257 

3.44 

.69 

79.29** 

256 

Visuotines kokybes sistema 

Total quality system 

257 

3.97 

.70 

67.49** 

256 

Halo efektas 

Halo effect 

257 

3.67 

.58 

102.01** 

256 


Pastaba: *p < 0,05 ir **p < 0,01 
Note: *p < 0.05 and **p < 0.01 
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PAGRINDINIAI KINTAMIEJI 

SK. 

VID. 

SN 

t VERTE 

df 

MAIN VARIABLES 

N 

M 

SD 

f-VALUE 

Destymo efektyvumas 

Instruction effectiveness 

600 

3,10 

.65 

116,30” 

599 

Halo efektas 

Halo effect 

600 

3,08 

.46 

163,66” 

599 


Pastaba: *p < 0,05 ir ”p < 0,01 
Note: *p < 0.05 and ”p < 0.01 


Pagal rezultatus, studenti} nuomone, 
destymo jvertinimo rezultatai turi jtakos 
destymo efektyvumui ir visuotines kokybes 
sistemos kurimui universitetuose. Be to, jie 
pritaria teiginiui: jvertinimo procese kai ku¬ 
dos destytoji} asmenines savybes gali veikti 
kaip halo efektas. 

Reikia atkreipti demesj, kad pagal kitus 
studentp demografinius kintamuosius nera 
jokio aiskaus rysio tarp amziaus, semestro, 
pagrindinio specializacijos dalyko ir univer- 
siteto kintamijji} bei jq poziurio j SjD metodo 
efektyvumq. 

Ketvirtasis klausimas - „Ar zymiai ski- 
riasi studenti} ir destytoji} nuomones apie 
SjD metodo efektyvumq?“ Nepriklausomos 
imties t testas buvo panaudotas norint pa- 
lyginti vidutinius balus, gautus tiriant des- 
tytojij ir studentp nuomon^ apie destymo 
efektyvumo poskalf. Rezultatai pateikti 
5 lenteleje. 

5 lenteleje pateikta tyrimo kintamijji} 
aprasomoji statistika ir t vertes. Si testo ana- 
lize rodo, kad 257 destytoji} vidurkis tyrimo 
skaleje (su dviem poskalemis) - 3,44 ir 3,65. 
600 studenti} vidurkis yra 3,10 ir 3,61. Dvi- 
pusis reiksmingumo testas parode (f=6,86 ir 
t= 2,85, df= 855, P<.01) reiksminiq skirtumi} 
tarp destytoji} ir studenti} nuomonii}. Galima 
padaryti isvadc}: destytojai buvo bendresnes 
nuomones apie SjD metodo efektyvum;} nei 
studentai. 

Penktasis klausimas - „Ar galima rasti 
rysj tarp studenti} demografinii} kintamijji} 


4 lentele. Studenti) nuomone apie pagrindinius kintamuosius 
Table 4. Students'View Regarding Main Variables 


These results reveal that students reported 
that the results of teaching evaluation have im¬ 
pact on instruction effectiveness, as well as de¬ 
veloping a total quality system in universities. In 
addition, they agreed with this statement that 
some teachers’ personal factors throughout the 
evaluation process could work as a halo effect. 

It should be noted that, in respect to 
other students’ demographic variables results 
showed that there were no significant relation¬ 
ship between age, semester, major and univer¬ 
sity variables with their view regarding effec¬ 
tiveness of SET. 

The fourth question asked “Is there any sig¬ 
nificant difference between students and teach¬ 
ers’ view regarding effectiveness of SET?” For this 
purpose, means scores of teachers and students’ 
views regarding teaching effectiveness sub-scales 
were compared using the independent samples 
t-test. The results are highlighted in Table 5. 

Table 5 shows descriptive statistics and 
f-values for variables in the study. This test 
analysis indicates that the 257 teachers have 
a mean of 3,44 and 3,65 on the research scale 
(with two subscales), while the 600 students 
have a mean on 3,10 and 3,61. The two-tailed 
significance test indicate (f=6,86 and f=2,85, 
df= 855, P<.01) that there is a significant differ¬ 
ence between teachers’ and students’ view. Our 
overall conclusion is that teachers were more 
in agreement with effectiveness of students 
teaching evaluation than students. 

The fifth question asked “Is there any re¬ 
lationship between students’ demographic 
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5 lentele. Destytojq ir studenti) nuomoniqapie pagrindinius kintamuosius palyginimas 
Table 5. Comparison of Teachers and Students'View Regarding Main Variables 



DESTYTOJAI (SK.=257) 

STUDENTAI (SK.=600) 

t VERTE 

PAGRINDINIAI KINTAMIEJI 

TEACHERS (N=257) 

STUDENTS (N=600) 

(df= 855) 

MAIN VARIABLES 

VID. 

SN 

VID. 

SN 

f-VALUE 


M 

SD 

M 

SD 

(df= 855) 

Destymo efektyvumas 
Instruction effectiveness 

3,44 

.69 

3,10 

.65 

6,84** 

Halo efektas 

Halo effect 

3,65 

.31 

3,61 

.30 

2,85** 


Pastaba: *p < 0,05 ir **p < 0,01 
Note: *p < 0.05 and **p < 0.01 

ir jij nuomones apie SfD metodo efekty- 
vum|?“ Pirmiausia nepriklausomij imciij 
t testas panaudotas lyginant moterij ir vyrij 
studenti} ball} vidurkj, gauti} vertinant desty- 
mo efektyvumo poskales. Rezultatai pateikti 
6 lenteleje. 

6 lenteleje pateikta tyrimo kintamijjij 
aprasomoji statistika ir t vertes. Si testo ana- 
lize rodo, kad 307 studencii} vidurkis dviem 
tyrimo poskalems buvo 3,11 ir 3,14. O 293 
studentp vidurkiai - 3,10 ir 3,02. Dvipusis 
reiksmingumo testas parode (f=3,02, df= 598, 
Pc.Ol) reiksminii} skirtumi} tarp moterij ir 
vyri} studenti} poziurio j halo efekto poska- 
1§. Galima padaryti isvadt}: studentes yra 
vieningesnes nuomones nei studentai, kai 
kalbama, jog destytojo charizma ir atlaidu- 
mas gali tureti jtakos destymo jvertinimo 
efektyvumui. 


variables and their views regarding effec¬ 
tiveness of SET?” For this purpose, at first 
means scores of female and male students’ 
views regarding teaching effectiveness sub¬ 
scales were compared using the independent 
samples t-test. The results are highlighted in 
Table 6. 

Table 6 shows descriptive statistics and t- 
values for variables of the study. This test analysis 
indicates that 307 female students have a mean 
of 3,11 and 3,14 on the two research subscales, 
while the 293 male students have a mean on 
3,10 and 3,02. The two-tailed significance test 
indicates (f=3,02, df= 598, P<.01) that there is a 
significant difference between male and female 
students’ view regarding halo effect subscale. Our 
overall conclusion is that female students were 
more agreement with this notion that some fac¬ 
tors like teachers’ charisma and leniency of/affect 


6 lentele. Vyrq ir moterq studenti) nuomoniq apie pagrindinius kintamuosius palyginimas 
Table 6. Comparison of Male and Female Students'View Regarding Main Variables 


PAGRINDINIAI KINTAMIEJI 

MAIN VARIABLES 

MOTERYS (SK.=307) 

FEMALES (N=307) 

VYRAI (SK.=293) 

MALES (N=293) 

t VERTE 
(df=598) 

/-VALUE 
W/=598) 

VID. 

M 

SN 

SD 

VID. 

M 

SN 

SD 

Destymo efektyvumas 

Instruction effectiveness 

3,11 

.66 

3,10 

.64 

.033 

Halo efektas 

Halo effect 

3,14 

.49 

3,02 

.41 

3,02** 


Pastaba: *p < 0,05 ir **p < 0,01 
Note: *p < 0.05 and **p < 0.01 
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Sestasis klausimas - „Ar galima rasti rysj 
tarp destytoji} demografiniq kintamqjq ir jq 
nuomones apie S{D metodo efektyvumq?“ 
Tyrimo rezultatai rodo, kad destytoji} demo- 
grafiniai kintamieji (paskyrimas, jdarbinimo 
tipas, pagrindine studijq kryptis, destytojavi- 
mo patirtis metais ir universitetas) nera nie- 
kaip reiksmingai susijsj su jq nuomone apie 
S{D metodo efektyvumq. 

ISVADOS 

Demesys studijavimo ir destymo kokybei 
yra vienas svarbiausii} kiekvieno univer- 
siteto uzdaviniq bei butina sqlyga siekiant 
ir uztikrinant kokybiskq destymq. Svarbi} 
vaidmenj cia atlieka jvertinimas. fvertini- 
mas naudojamas profesinio tobulejimo ir 
palyginimo tikslais. Abu tikslai yra teiseti, 
o universitetai turetq skatinti abiejq rusiq 
jvertinimus. Vienas didziausiq studenti} 
atliekamo reitingavimo privalumq, kurj 
verta pamineti, - kuriant ir pildant jvertini- 
mo formas destytojai ir studentai skatinami 
reflektuoti savo patirtj svietimo sistemoje ir 
taip susikurti aiskesnq koncepcijq, kokip pa- 
stangu reikia norint pasiekti geresniu desty¬ 
mo ir studijavimo rezultatij. 

Sio tyrimo rezultatai rodo: destytoji} 
nuomone, S{D metodas tarn tikrais aspektais 
turi svari} poveikj destymo efektyvumui. Sie 
rezultatai sutampa su M. Burojeredniyao 
(2003), A. Arabkharadmando ir S. Hajiag- 
hajanio (1997), A. Shakorniyao ir kt. (2000) 
isvadomis. Be to, tyrimas atskleide: desty- 
tojp nuomone, SJD metodas yra svarbus 
diegiant visuotines kokybes sistemc}. Kita 
vertus, destytojai isreiske bendrc} nuomo- 
n§, nurodydami, kad kai kurie halo efektai 
(tokie kaip mokytojo charizma ar atlaidu- 
mas) gali tureti jtakos destymo jvertinimo 
rezultatams. 

Daugelis destytoji} teige, kad studentams 
butina surengti mokymus ir supazindinti 


on students perception of effectiveness of teach¬ 
ing evaluation than their male counterparts. 

The sixth question asked: “Is there any 
relationship between teachers’ demographic 
variables and their view regarding effectiveness 
of SET?” Results indicate that faculty member’ 
demographic variables (designation, type of re¬ 
cruitment, major, years of teaching experiences 
and university) have no significant relationship 
with their view regarding effectiveness of SET. 

CONCLUSIONS 

The importance of the quality of learning and 
teaching is a primary objective of every uni¬ 
versity and is a precondition for achieving and 
maintaining excellence in teaching. Evaluation 
as a critical element plays an important role 
in this regard. It serves unique professional 
development purposes as well as border pur¬ 
poses involving comparison. Both purposes 
are legitimate and both kinds of evaluation 
are to be encouraged by universities. One of 
the most important benefits of student ratings 
worth mentioning here is that the process of 
designing or filling out the forms encourages 
teachers and students to reflect on their edu¬ 
cational experiences, and as a result, develop 
clearer conceptions about what efforts they 
must make in order to achieve better teaching 
and learning results. 

Based on the results of this investigation it 
appears that SET has some significant effects 
on effectiveness of teaching from the teach¬ 
ers’ view. These results are consistent with 
Burojeredniya (2003), Arabkharadmand and 
Hajiaghajani (1997), Shakorniya et al. (2000) 
findings. In addition, the results show that SET 
has some significant effects on establishing a 
total quality system teaching from the teach¬ 
ers’ view. On the other hand, teachers reported 
their agreement with this notion that some 
halo effects like teachers’ charisma and leni¬ 
ency affect the result of teaching evaluation. 
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juos su destymo jvertinimo filosofija ir tiks- 
lais. Jdomu pazymeti: daugelis studentq 
pries uzpildydami isreiske poreikj issamiau 
susipazinti su jvertinimo formomis. Is viso 
tik nedidele dalis destytojq buvo patenkin- 
ti siuo metu Irano universitetuose naudo- 
jamomis strategijomis destymui jvertinti. 
Nei studentq, nei destytojq demografiniai 
kintamieji nebuvo labai reiksmingi jverti- 
nant destymo efektyvumq. Daugiausiai ir 
maziausiai naudingais reitingij saltiniais 
destytojai nurode, atitinkamai, absolventus 
ir administratorius. Apskritai, megstamiau- 
si destymo jvertinimo saltiniai destytojams 
buvo puikus absolventai ir studentai. 

Tyrimas atskleidzia abejones del SJD 
metodo naudojimo aukstojo mokslo siste- 
moje Irane bei kelia klausimus, ar teisinga 
ir objektyvu naudoti tokius reitingavimus 
priimant sprendimus, susijusius su desty¬ 
tojq pareigomis. Tyrimo rezultatai rodo: 
nustatant destymo kokyb^, SjD metodq rei- 
ketq naudoti itin atsargiai. Galiausiai reko- 
menduojama atlikti issamesnius tyrimus ir 
dar placiau istirti siame tyrime akcentuotus 
klausimus. 


Most of the teachers reported that it is 
necessary to organize some briefing sessions 
regarding goals and philosophy of teaching 
evaluation for students. It is interesting that 
most of students showed that they need to at¬ 
tend justification sessions before completing 
teaching evaluation forms. Totally, only a low 
portion of teachers satisfied with the current 
strategies to measuring teaching evaluation in 
Iranian universities. Both teachers’ and stu¬ 
dents’ demographic variables, in general, could 
not show any significant effect on evaluation of 
teaching effectiveness. Teachers ranked admin¬ 
istrator and alumni rating source were in the 
lowest and highest levels, respectively. Overall, 
the most favorite approaches for teachers were 
excellent graduates and excellent student. 

The study presents a challenge to the use 
of SET in higher education system in Iran and, 
in particular, raises questions about fairness if 
such ratings are to be used in decisions relat¬ 
ing to employment issues. The findings sug¬ 
gest that SET should be applied cautiously in 
faculty performance evaluation. Finally, it is 
recommended that a more extensive study be 
done to examine more comprehensively the 
question addressed in this investigation. 
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